Real-time tracking of face features and gaze direction determination

A non-intrusive real-time program detects the face, then eyes and nose of a moving workstation user at a rate of between 10 and 30 Hertz. Based on the head pose, it determines where on the display the subject is looking. The long term goal is to provide a system for controlling a computer using head movements and gaze direction. The current program creates a base facility for other capabilities such as detecting facial gestures, creating face models, and normalizing for face recognition. A skin color model is used along with geometric knowledge about the face and weak assumptions about the lighting. Good results are reported with various subjects and conditions, including facial hair, 3D motion, and use of eyeglasses.